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IDENTIFIEBS 

ABSTRACT • , ' . ^ 

. As part of a period of self-study, representatives of 
the Dniversl^K^ of , Texas at Austin (OTA). Coimittelr>Qn Graduate Heading 
contacted 26 leaders in the field of reading.' These^eadiers were 
asked to rank the t6p ten graduate readin,^ programs in the O.S. and 
Canada, to place DTA, in relation to- the top ten, and/ to coiaent on 
the placement cf OTA*, Responses from 19 indiViduals^were tabulated 
and discussed. The .limitaiions. of such questionnaire reports are also 
considered. (AA) 
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EXTERNAL EVALUATION TO .IMPROVE ,LOCAL GRADUATE READING EDUCATION PROGRAMS 

\ ' , / X 

' - Thoma's D. HtTrn N 

As part of a perlbd of self study In terms of external evaluation - 

^ during the 1976-77 academfc year, representatives of. The Univers it^y of 

^ Texas at Austin (UTA) Committee on Graduate Reading contacted twentv-sixx 
vO * . 

leaders in the field of read i ng, .r&present i ng twenty-three different U S 
t-H, • • ^ 

Q ^ anj two Canadian institutions, for responses to a very' brief questionnaire. 
Tnese. individual's were asked to respond to the. f ol 1 owi ng : (l) Excluding 
your owr^ institution, , which graduate reading programs would you place 
■ in the top ten In the United States and Xanada? Please order your s-elec- 
tions if possible". (2) Where would you place the graduate reading pro- 

# 

gram at Tne Un i vers i ty .of Teiias at Austin relative to your , top -ten identi- 
fied above? and. (3) Comments concerning your ' p 1 acement of The University 
of Texas at '.Austin. v % s 

i>escrip.tions of the currently activd graduate reading programs were 
(T.cluded with the questionnaire and the eleven regular faculty members 
participating in the UTA reading program were identified as representing 
■ the following ten institutions: Berkeley, Chicago, Indiana, Iowa, Michigan, 
Minnesota, North Cafolina, Tennessee, Jexas and Wisconsin. Ah additional" 

^twelve to fifteen doctoral and graduate students plus sdme- undergraduates 

. • \ 

on the reading specialist program assist in Instructional activitres oT^ui^ 

^ ' ■ / ^ 

the readjng ma teri al s. laboratory . Space allocations of 11,700 square feet 

fare provided in the new Education Building ^or the Learning Disabilities 

Center (LDC) and the Read i ng* Mater i al s Laboratory; 

^ Since approximately 50^ of both the graduate and undergraduate programs 

^ involved practicum experiences , "on-site" instructional space Is provided , 

% • . 

FRir 



oy the Aubtin Independent School District In* flv§ or six elementary 
ucnoolb each semester of the. academic year. Since not alKof these schools 
arc dpc'n In the summer, graduate and undjjrgraduate practicum experiences ' 
are provided by the LDC. ' During the 1976 summer session, over 200 children 
constituted the basis of the pragticum experiences for on-campus reading 
instruction. . 

Of the nineteen individuals responding: , 

^ declif^d to identify the top ten graduate programs, one of whom 
ranked UTA 4th or 5th (tabulated as 5th); one indicated faith in 
UTA staff quality,, but lacked solid facts for an unequivocal response 

3 idencified the top tea programs, but declined to rank <arder them, 
iwo of whom mentioned UTA in the top ten; and one declined Vo ran^ 
UTA on tne basis of being unfamiliar with the progr-am per se. 

12 luentified and ranked ( severa 1 ^ nd i ca ted that their rankings were 
suspt^ci) the top ten graduate procirams in ^ding (excluding 'their 
.own|itibci tut Ion) , *and ranked UTA as follows • 
5 top five-- * 

3 oelaw top ten, one of whom said, "Somewhat bellow in termb 
of visibility have seen some good products." A seconti 
said, "Pf^obably .among the next five." 
A total of thirti-six institutions were identified by the respondcr.^t, . 
c.Dle 1 indicates thosle institutions which were mentioned as having graduGce 
ouding programs i^^ihe top ten on the basis of number of mentions are tnus 
^entified and ordered: Georgia; Syracuse and UTA; Indiana and Wisconsin; 
ir.nesota; Berkeley, and Arizona; and Yemple anJ Alberta. 
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Table^l 

' INSTITUTIONS MENTIONED MOST TIMES IN TOP TEN 

. ' Number of Mentions 

Georgia / 13 

, Syracuse -fV- • • . . . . 12 

UT Austin ]2 

1 nd iana ]q 

.Wi scons in jq 

Minnesota ^ n 

ocfkeley . | , y 

Ar i zona ^ . . ; y 

*^^-^ple 6 

A) ^Derta . . ^ . . , ^ ^ 

Ohio Slate U> . ... . . \ . ... . .5 

Bu f f a ] O ^ , , ^ ^ ^ ^ ^ 

.iofstra . *. _ ^ . ^ ^ ^ ^ 

Arizona State U. . . . , . . , ^ ^ 

I'^jdry land . . ^. , . . ^ 

Jos ton . . . . , . . . , , , ^ ^ ^ 2 

P; ctsburgh ^ ^ ^ 

I 1 I i no i s ^2 

3r I t i sh Col umbla , 2 

I s sour i : , ^ \ ^ ^ ^ ^ 2 

1^. i u.ni . * 2 

jc I aware \ 2^ 
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Taole 2 indicates those institutions mentioned the most times as 
being in "the top five graduate reading programs. The top five according 
to the most mentions are therefore identified and ordered as: Georgia; 
Syracuse; Indiana, Minnesota and UTA. Of these, only UTA failed to 
receive at least one ranking of either 1 or I. the next ranked programs, 
i/lsconsin and Alberta, both received rankings of 1 and/or 2. 

Table 3 identifies those institutions mentipned once only, with 
their rank, if indicated by the respondent. 

Table k reflects the ranking tabulation for all i ns t i tu t ions men- 
Li or.ed in tne various responses. By way of explanation of the "not 
(r.or.tioned"_^^column, WA was not mentioned b.y only one respondent, most 
probcibi/ because it was the institution requesting information. in 
ir,c case of the University of Georgia, if one of the Respondents re- 
presentee, that institution and excluded (as directed) his or her own 
:r. tne program identification ranking, only one other respondent did 
r^ol mention the Georgia program; in the case of Syracuse, if one of 

respondents represented, that institution, he or she would exclude 
Syracuse from the rankings, hence two respondents did not mention the 
Syracuse program. A similar analysis may be made for the other institu- 
tions in Tables 4 which were not mentioned by two or more respondents. 

l.n the "below top ten" category, UTA was the only institution showing 
^ a .adulation since this was specifically requested in the questionnaire; 
for tne rei>t of the programs, the tabulations in the "not mentioned" 
col^iiTin will be of interest. . . ' 

To summarize briefly, UTA: (l) tied (wi th "Syracuse) for second 
behind Georgia for the number of mentions in the top ten; (2) ranked 
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Table/2 

INSTITUTIONS MENTIONED /^^^ TIMES IN TOP FIVE 



Inst i tut ion* 



Number of Mentions 



"•.jjecfrgia . 
Jy >a.^:wse . 
Indiana . 
Minnesota 
OJ Austin 
W'i scons i n 
Alberta . 

Bcrke I ey . . . . . 7 . . , , .2 
Temple ••.../.,..,, 2 

Ohio State U 

i 1 U no i s . . . • / • \. - . . , , 2 

3ot>ton 

Arizona . . 
Buffalo SuNY . 
Arizona State U 
P 1 t tsburvjh 
Br i t ish Co]un>6ia 
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INSTITUTIONS MENTIONED ONCE- ONLY ^ 



'""^'^"^•Q" ■ ; ' " Ranking of 1-10. 

'OiSE Toronto . . / . , . . . . ' // ] 

. I 

Northern Colorado . ; ' ^ ^ // 2 ' 

A;b.Qny SUNY // ^/^ 

Harvard . ^ . ^ 

Missouri Kansas City . >. // § ' 

Mchigan Stat^;U. . . . . . . . . . // 7 

FiorlJa. . . . . . ■ , . . // 10' 

Sou^n Florida. . , but 'not ranked 

a\ c I a n t a . ♦ , . . , . , » ' ^ n n 1 1 1 1 1 1 

of i-'Minoib N.E. (sic). .... ' m . n 

^'Cuij i f* • ^ ^ . n ,, ^ H 
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uiM r.o^j .6 res.ponses due to a respondent who decllneu to Identify/top t^r, 
j^z .'unked bTA k or _5. Deletion of th^s response from the t^bulqtion coes 
vfect :ne fdcnt if ixat Ion of top five and ten. 
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wicn indidna and Minnesota behind Georgia and Syracuse in the times mentioned 

in the top five; and (3) did not receive any rankings higher, than 3. 

Oirrerent results would undoubtedly be derived from a different sample 

of reading educfittors; however, the individuals contacted .are as knowledgeable' 

In the reading field as most anyone in the United States and Canada The 
^ ' . >■ 

cxcent of positive bias toward the UTA program merely because of UTA being 

y 

ir.c iri^cjuiring institution is unknown. A'lso, little confidence can be placed 

> . / ' 

che''.significance of the difference between, say/ Institution A beinq 
mJr.cionea In the top ten seven tidies and, l.nstity/lon B being mentioned six 
.:„,es. because the purpose of the survey was to further improve the UTA 
.-cudmg program, the rankings are of most value as a general ^context against 
.vr. :ch lo assess the quality of the UTA program. 

Comments on the returns reiterate the quandry evaluators face as to 

:r.^ critical factors on which an evaluation should be based. Such factors 

, , • ' /f' 

...^iboe: ocop,o what is known of the staff quality a^d support 

^L^rsonne] of the program; (2) program — what har<4 data are available as 

to prograni structure, theoretically and actually, an^ the amount and quality 

^: opace allocated to support the program.; and by (3) product — whe^ is 

xr.own of the quality evidenced by graduates of the program. 

Most of us are aware of the fact th'at questionnaire studies have faults 

jT.J tnat on-site evaluation^ are necessary to substantiate or modify the 

,..cst ionnai re results. The first on-site external evaluator spent two days " 

L oTA in July, 1976 for this purpose. In the ♦meantime as the reatal car 

Gvertisement goes, "When you're No. 2...^.." 



Appendix 

Comments goncferning Placemen t 
of UTA Graduate Reading program 

Comments ' 

-* -- ^ » 

Good balance among elementary, secondary, and reUted 
work, etc. 

Excel lent staff - 
Articulated progrj^m. 

Caliber of graduate students I mean graduates 

Clinic fac i 1 i ty ' 

Public school orientation ' ' - 

A lot of the Texas personnel are /St I 1 1 rather young, so 
Texas at Austin should become even more outstanding as 
these people mature and gain In national recognition, 

Asl(3e from the five institutions listed above, I do not 
think there are five other outstanding i ns t i tut i on5 • ^ 
The majorlty^of graduate reading programs are'not parti- 
cularly impressive. 

Text's has. a strong, d I ver.s i f i ed -f acu 1 ty . It also pro- 
vides excellent opportunities for interdisciplinary 
study on the part of graduate students, because of the 
power of related departments In the University. . 

It Is difficult to place a program judging by course 
titles. Jt is the guaj i ty of the instruction that 
makes the d I f f erence . At Texas I am judging largely 

by Professor . I know him well and have only 

the highest regard for his ability and- devotion. I 
know that he would surround himself only with able 
'people. 

I would not caroi ro try to rank order the top ten 
graduate reading programs. I can say that I would 
place Texas somewhere in the top ten probably about * 
the middle of the t6p ten, i.e. rank of ^ or 5^. 

No comments, 

I know the program listed above of 1, 2, 3, 5 and 10 
quite well,, the others less well. Your program at 
Texas seems quite complete but I really know little 
about it. • * . 

Is I n a top quail ty i ns t i tut ion but tends to have a 
regional influence. ^ 




, ' ^ ' ^ Appendix (cont'd) 

^^nk , . Comments . ' " * 

* The weakness of Texan's graduate reading program is 

that it is not sufficiently ried to theoret i ca 1 and 
experimental work i-n^ cogn i t i ve psycfioiogy and^ other 
fields. Texas's strength is that it has a very strong 
curriculum'^and instruction and school emphasis. 

I wouldn't want Texas to change directions 180*^, but a 
•» • 20-40^ deflection would help. There are some very 

knowledgeable people over in your psychology department 
and your 1 i ngu 1 s t i cs dd^artment. * 

Top ten but Contend appropr iate ' as indicated in the enclosure except 

not ranked. • f©r the C 1 i n i ca 1 /Remed i a 1 , which appears to need more 

breadth in developmental areas and expansion of the 

remedial practicum. 
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Top ten but Good staff, meaningful research 

not ranked ^ " 

ielow top ten. ► Somewhat below in terms of visibility though I've seen 

some good products. ^' ' , 

iNoxl live Ypu have several excel lent facul ty members The faculty 

'^'^•"^i^) * • is a little smaller than at some other institutions and 

probably cannot off^r doctoral courses i7) equal variety 
; and depth. Your school has a fine reputation, however. 

3uiow t©p ten. A program is jutlged largely on the basis of gradi^tcs of 

that program apd the people on the faculty. . I donHj' know 
any doctoral o^raduates of the Texaspprogr^m. I know^ 
three of the Texas facu 1 ty ^membe/^Suif two of tKese are 
■ wel K known .' Of/gr i ngs i^i reading are limited. (Dat^ 

orh<£acu 1 ty came from recefff IRA publication.) j ^ 

Mo::' mentioned . No comments.* - 
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